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ABSTRACT 

The purpose of the 1968—69 investigation was to 
determine the applicability of a curriculum evaluation model to 
investigate high school students* achievement in three physics 
courses (traditional physics. Physical Science Study Curriculum, and 
Harvard Project Physics) . Three tests were used to measure studen 
progress; The Dunning- Abeles Physics Achievement Test, Form E.„ the 
Wisconsin Inventory of Science processes, and the Watson-Giaser _ 
Critical Thinking Appraisal, Form YM. The classroom verbal behavior 
of each class was recorded on audio tapes and quantified using 
Flanders 1 verbal Interaction Analysis system. The results of the 
study indicate that the students exhibited greater change in physics 
content mastery than in understanding science processes or m 
critical thinking, although there was a significant increase m all 
three components. No specific curriculum was 3e more 

effective in enhancing student abilitv-growt - fhe three 

tested components (physics content, under standing science processes, 
and critical thinking) . The total classroom verbal interaction 
patterns were found to differ among curricula and between nigh and 
low achieving classes, leading to the judgement that there is a 
relationship between classroom verbal behavior and a physics 
curriculum as well as a relationship between classroom verbal 
behavior and staflent achievement. The funds for this octora 
dissertation were provided by the U. S. Department of Health, 
Education, and Welfare. (Author/TS) 
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Abstract 

The purpose of the- present invest igati on _ was to deter- 
mine the applicability of a curriculum evaluation model to 
investigate high school students* achievement in three physics 
courses (traditional physics. Physical Science Study Curriculum, 
and Harvard Project Physics). The model was based upo,. the 
premises that (a) evaluation should be viewed as a dua 
of description and judgment, (b) evaluation should contain a 
description of instruction and its relationship to student out- 
comes, (c) teaching -is a process of interaction, (d) learning 
is a consequence due to the effect of classroom verbal behavior 
intersecting with a curriculum, (e) knowledge and learning con- 
sist of both content and process, and (f) these attributes can 
be described quantitatively. 

The evaluation model was applied to a sample consisting 
of 954 students enrolled in 38 classes taught by 26 teachers. 
This sample was randomly selected from approximately 150 schools 
which offered one of the three selected courses during the 1968- 
1969 academic year, thus enabling inference to high school. 
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physics curricula in the southwestern, midwestern, and western 
United States. 

Formative experiences of the students— academic aptitude, 
age, curriculum, grade level, and sex — were assessed and neces- 
sary statistical controls applied. A battery of three tests 
were administered twice, once upon entry into the curriculum and 
once upon completion of the curriculum. The battery consisted 
of the following tests: 7 the Dunning-Abeles Physics Achi evement 
Test. Form 2 ; the Wisconsin Inventory of Science Processe s,; and 
the Watson-Glaser Cri tic al Thinking Appraisaj , Form .YM. The 
classroom verbal behavior of each class was recorded on audio 
tape four times throughout the 1963-1969 academic year, and 
subsequently quantified by application of Flanders’ Verbal, Inter- 
action Analysis system. 

A three-factor analysis of variance mixed design with 
repeated measures on two factor's was used to analyze student 
achievement data for curricula, tests, and pre-post dependent 
variable dimensions. The classroom verbal interaction matrices 
were analyzed across curricula and as to the two extreme levels 
of student achievement. Nonparametr ic tests were employed as 
appropriate to determine differences in total classroom verbal 
interaction patterns, category differences, and differences 
among four selected aspects of classroom verbal behavior (indi- 
rect-direct ratio, teacher-talk ratio, student-talk ratio, and 
content ratio ) . 
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The secondary school physics students were found to be 
above average in academic ability and neither grade level nor 
sex of a student was a determining factor as to his level of 
physics achievement. The three curricula were judged to be 
equivalent and effective in implementing the learning of physics. 
The students exhibited greater change in physics content mastery 
than change in understanding science processes or chaa^e in 
critical thinking, although there was significant increase in 
all three components. No specific curriculum was found to be 
more effective in enhancing student ability growth in any of the 
three tested components (physics content, understanding science 
processes , and critical thinking). 

' The total classroom verbal interaction patterns were 
found to differ among curricula and the total classroom verbal 
interaction patterns also differed between high and low achiev- 
ing classes. This led to the judgment that there is a relation- 
ship between classroom verbal behavior and a physics curriculum 
as well as a relationship between classroom verbal behavior and 
student achievement. Due to the problems involved in statisti- 
cal isolation of the differences in patterns, a description of 
specific causal relationships was not possible. 

The curriculum evaluation model was found to be valid 
and applicable in evaluating three physics curricula. However, 
such application was found to be hindered by the lack of preci- 
sion in measuring instruments and non-robust statistical 
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techniques for assessing key difference points within the 
classroom verbal interaction matrices * 
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During the past decade many new curricula have been 
developed for me sciences. These curricula v/ere developed 
because of an increased awareness of needed reforms in the 
sequencing and structure of science instruction. In develop- 
ing these new curricula, science educators raised many ques- 
tions about the kinds, the methods, and the quality of courses 
taught in American high schools. The basic considerations in 
these new programs have centered upon selection of materials 
to teach and methods of presentation of the selected materials. 

These new texts, materials, and instructional proce- 
dures have been introduced into sci ence classrooms in an attempt 
to achieve more nearly the goals of science education. The 
introduction of these materials and procedures may be consid- 
ered one of the critical factors in implementing change in 
science education. 

Systematic evaluation is a means of gaining insight 
into the effectiveness of these curricula. A general evalua- 
tion model may be developed to aid in systematizing the eval- 
uative process and to insure the consideration of key variables 
in complex teaching-learning environments. This study will 
apply such an evaluation model to 3 specific area of science 
education, physics. Evaluation of these curricula should 
reveal durable relationships that would serve as a guide for 
changing or modifying instructional programs in science. 

1 
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Background of the Problem 



The total public school enrollment in the T Jr.' id States 
has been increasing since 1890. During this same per od of 
time, the percentage of high school students takii g j ysics has 
been continuously declining while other areas of e’cie ce such 
as biology, chemistry, earth science, and mathematics have not 
shown such declines in enrollment. For example, in 1B90, 22.8% 

of the total high school enrollment was in physics; in 1933, 
only 8.9% was in physics; and in 1957, the percentage in physics 
was 4.5% (National Education Association, 1957). A i ther 
examination revealed that during the 1963-1964 school year only 
one in five twelfth-grade students was enrolled in any type of 
physics course (Watson, 1967). This trend of declining enroll- 
ment relative to total high school enrollment is a major con- 
cern of many educators. The reasons for such a trend have not 
yet been determined. 

Brown (1939), one of the first educators to exhibit 
concern about the physics curricula of the early 1900's, criti- 
cized not only the unit concept, but also the unchanging nature 
of the units within the traditional physics (TP) course. These 
units were generally classified under the headings of mechanics, 
heat, electricity and magnetism, and sound and light (Beauchamp, 
1933). Henry, in Science Education in American Schools (1947), 
stated: "The picture we get is a subject, physics, gone stale 

through adherence to a set and largely nonf unctiona- pattern of 
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organization" (p. 209). The prevalent belief was that the con- 

tent of physics was a verified and certain body of facts. As a 
result the teaching of physics was dominated by this belief. 

To facilitate the transmittal of facts, the classroom method of 
instruction was primarily lecture or lecture-demonstration fol- 
lowed by a directed type of laboratory exercise (Stollberg, 

1960). Over the years, teaching in physics had become equated 

with "telling." 

Minor revisions have been made in organization of the 
units of the TP course. What is referred to as a "traditional" 
physics course seeks to familiarize the student with virtually 
all aspects of physics. Emphasis on the role of the physics 
teacher has changed within the TP course from one of imparting 
knowledge by telling or lecturing to one of directing the learn- 
ing process. These minor revisions have not resulted in marked 

changes in enrollment trends. 

In 1956, a more radical revision of the physics curricula 

was proposed by the Physical Science Study Curriculum (PSSC) 
project, under the direction of Zacharias at Massachusetts 
Institute of Technology. PSSC attempts to present physics as a 
unified but continuing process by which man seeks to understand 
the nature of the physical world. Emphasis has been placed on 
relatively few concepts viewed as basic to the underlying struc- 
ture of physics. Laboratory investigations were designed to 
encourage the students' spirit of inquiry. Diadactic classroom 
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presentation was de-emphasized and inquiry teaching was encour- 
aged. However, many educators (Watson; Rutherford, 1967; 

Helton, 1967) felt that PSSC was not meeting the needs of many 
students due to the depth of the conceptual development neces- 
sary for success in the course. 

A second attempt to modify the physics curriculum has 
been through the efforts of Harvard Project Physics (HPP). 

HPP , under the direction of F. James Rutherford , Fletcher Wat- 
son, and Gerald Holton at Harvard University, developed a 
"second generation" physics course for national use. This course 
was developed for the purpose of providing a physics course with 
maximum flexibility of content, emphasis, and teaching methods. 
Emphasis was placed on independent study for maximum content 
mastery, process acquisition, attitudinal changes, scientific 
literacy, and career guidance (Watson, Rutherford, Holton). 

HPP was first introduced into physics classrooms during the 
1968-1969 academic year. The effects of the curriculum are cur- 
rently being investigated. 

TP, PSSC, and HPP are being utilized concurrently ia 
American high schools. PSSC and HPP have resulted in increased 
emphasis on student-centered activities in the classroom, 
resulting in a change in the role of the teachers from a "teller" 
te a resource person and in a change from highly structured 
classrooms to laboratory classrooms. The TP has also reflected 
similar changes in emphasis. 
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Although the general emphasis for the three curricula 
is the same, each one approaches implementation of the emphasis 
in a unique manner. The question of the relative effectiveness 
of the three curricula in reaching the common objective of pro- 
viding a physics curriculum to meet the needs of today's young 
people is thus seen to be of utmost importance « 

Statement of the Problem 

The purpose of the investigation was to determine the 
applicability of a curriculum evaluation model in investigating 
high school students' achievement in three physics curricula 
(TP, PSSC, HPP). In applying the evaluation model, the common 
objectives from each curriculum are selected for measurement 
and decision making. 

Four general questions are considered within the model : 

1. Are there differences among composite student 
achievement change scores for the three physics 
courses? 

2. Are there differences in student achievement among 
•the three courses for each of the achievement mea- 
sures? 

3. Is there a relationship between classroom verbal 
behavior and student outcomes in each of the three 
courses ? 
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4. Is there a combination of classroom verbal 

behavior categories and a particular physics course 
that produces maximum student achievement? 

Description of an Evaluation Model 

Rationale 

The simple assertion has been made in educational theory 
that the function of the school is to change or develop behav- 
iors « Xn studying the productions of these behaviors and the 
educational programs intended to produce them, both behaviors 
and programs must be viewed in terms of their constituent vari- 
ables* The primary purpose of instructional theory is to make 
more precise the understanding of the relationship between edu“ 
cational environment (independent) variables and behavioral 
outcomes (dependent) variables, so that the independent variables 
can be manipulated to produce maximum values of the dependent 
variables (Ausubel & Robinson, 1969). 

Evaluation 1 s major role in developing a theory of 
instruction is to furnish information about relationships between 
the educational environment and behavioral outcomes. Cronbach 
(1963) has proposed that the main objective for instructional 
evaluation is to add description of instruction to the tradi- 
tional description of pupil outcomes and to seek a description 
of relationships between them. Evaluation has been further 
viewed as a dual process that includes^ £>oth description and judg- 
ment of a curriculum (Stake, 1969). 
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Although teaching and learning are distinctly different 
processes they are so closely related in the classroom that to 
describe and evaluate one while failing to investigate the other 
could seem an untenable approach to the development of an instruc 
tional theory. 

The teaching-learning process is multidimensional and. 
for a single study bo examine all the dimensions would be an 
impossibility; therefore, a theoretical position must be assumed 
in viewing teaching and learning. Stake believes that: "In 
the matter of selection of vciriables for evaluation, the evalua- 
tor must make a subjective decision. Obviously, he must j.imit 
the elements to be studied. He cannot look at all of them" 

(p. 353). 

In the present study a theoretical model for evaluation 
has been devised based upon the conviction that practice must 
have a theoretical basis and a valid theory must have supportive 
evidence in application. Therefore, from practice one can 
derive clarification and redefinition of theory (Van Dalen, 

1959) . 

The evaluation model is based upon the premises that: 

(a) the teaching-learning process is an open, multifaceted sys- 
tem; (b) the major interactive components of the system are 
teacher behaviors, student behaviors, and curriculum; (c) each 
major component may be represented quantitatively by sampling 
specified behaviors or materials; and (d) evaluation is a dual - 
O 
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process which consists of description and judgment of the sys- 
tem. The underlying bases of the model are the ideas for eval- 
uation proposed by Stake and Biddle (1964). 

The Model 

The model consists of five major components (Figure 1). 
Each component is considered as interacting with the four other 
components in the dynamic environment of "reality." Theoreti- 
cally, the five components may be sampled from and examined in 
a stable, independent state permitting inference as to the rela- 
tionships of components when operating in "reality. 

Figure 1 presents the five components (behavioral goals, 
formative experiences, transactions, outcomes, and judgments) 
separated logically in terms of the temporal sequence in which 
they occur. A simplified representation of the cause-and-ef f ect 
sequence is indicated by the arrows connecting the components. 
Each of the various components will be discussed in order as 
they appear in the temporal sequence. 

Components of the Model 

Behavioral goals . Goals are statements which describe 
what the student should be able to do after completing an 
instruction sequence. The use of behavioral goals in evaluation 
of curricula has been advocated by many educators (Tyler, 1950; 
Bloom, Engelhart , Furst, Hill & Krathwohl , 1956; Mager , 1962; 

Glaser, 1965; Gagne, 1967; Popham, 1969). 
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Formative experiences . A formative experience is any 
encounter or condition existing prior to teaching and learning 
which might relate to student outcomes. Ausubel & Robinson 
have pointed out the most important factors influencing learning 
are the quantity, clarity, and organization of the students* pre- 
sent knowledge prior to entry into a curriculum. This knowledge, 
available at any point in time, is referred to as his cognitive 
structure. Thurstone (1947) has shown th~.c background charac- 
teristics of age, sex, intelligence quotient, and prior training 
or education are potential influences on students* achievement 
or outcomes. These characteristics cannot be expected to remain 
invariant from student to student or class to class. Thus some 
control must be utilized in evaluation to compensate for the 
differences within a sample under investigation. 

Transactions -. Transactions are the many encounters of 
teacher with students, students with students, teacher with sub- 
ject matter, and student with subject matter. The interaction 
of these elements (teacher, student, and curriculum) form a triad 
which is dynamic in nature. This common concept of teaching as 
a process of interaction has been shared by Hughes (1959), Smith 
(1960), Beilack (1966), and Hyman (1967). Teaching is viewed 
in this dynamic triad of elements as the outcome of the inter- 
active forces which produce student behavior change. Figure 2 
shows the triad and the dynamic nature of the interactions. 
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Each element influences and is influenced by the rela- 
tionship between the other two elements. The interaction between 
any two of the elements influences the mode of reaction of each 
of the two to the third one and, in turn, how ail elements will 
react simultaneously. 




Teaching Triad 




Outcomes . Outcomes are the measured consequences of an 
instructional system. These consequences may include a descrip- 
tion of attitudes, cognitive development, role-perception, class- 
room climate, and social adjustment. Of the many attributes of 
the learning environment , the consequences selected for measur- 
ing must be isomorphic to the behavioral goals „ The outcomes 
describe quantitatively the extent to which the educational goals 
are being attained. 
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Judgments . Judgments are decisions as to relative 
effectiveness of alternate approaches to attaining educational 
goals. Various aspects of the consequences may be compared and 
judgments formulated. 

Of these five components, only the transactions stage 
may be viewed as dynamic. This dynamic stage connects uhe four 
relatively static components into an integrated sequence. 

Application of the Model 

Through the model, an attempt was made to measure the 
relative effectiveness of three physics courses (TP, PSSC, HPP) 
and the relationships of described classroom verbal behavior to 
student outcomes. Relative effectiveness among three physics 
curricula is defined as change scores between the pretest and 
posttest on selected criterion instruments. 

Behavioral Goals 

Two basic goals of science teaching were chosen for 
investigation because they are important cognitive skills expected 
in the student after completion of any curriculum or course 
(Stollberg; Victor & Lerner, 1967; National Science Teachers 
Association, 1970). These two basic goals are content of science 
and processes of science. Content of science surrounds acquisi- 
tion of concepts, facts, theories, and principles. Processes 
include the many abilities, skills, and attitudes that make crit- 
ical thinking and problem solving possible. Process is the means 




13 



by which resl learning of the content of science takes plac - in 
the science classroom (Victor & Lerner ) , From this point o. 
view, processes are subsets of content learning and cannot be 
separated or dichotomized. To evaluate the effectiveness of a 
science curriculum, it is essential to measure change in both 
content and processes. 



Formative Exper fences 

The ma;or formative expediences were considered tc ^e 
(a) length of . ime in the educational environment, (b) difrar- 
ential effects of cultural roles, (c) clarity and organization 
of cognitive structure, and (d) prior learning specific tc the 
physics curricula. The criteria selected for these experiences 
were grade level, sex, academic aptitude, and content-processes 
pretests . 



Transactions 

The transaction component consists of three teaching- 
learning triads, each designated by a specific physics curricu- 
lum. Each triad consists of the variables within the classroom. 
Within each physics course the teacher has specific patterns of 
behavior which become interactive with students and their cogni- 
tive modes. 

A teacher's method of instruction is a pattern or manner 
of treating students, classroom events, and subject matter. When 
the teacher and students interact; both use words to communicate 
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ideas* The daily activities in the classroom are sustained 
almost entirely in talk between teacher and students Aschner, 
1961). /erbal communication is used in exchanging _deas about 
facts, concepts, principles, generalize dons, and definitions. 
Smith (1956) contends that teaching ca: not occur win tout the 
use of language. Similar positions hate been taken by Bel lack 
and Amidon & Flanders (1963). 

Analysis of the physics classroom thereby consisted of 
systematic observation and quantification of the p interns of 
classroom verbal behavior . The most promising or x_ _ical 
approach to this quantification is that of Flanders sBelanger, 
1964). Flanders' Verbal Interaction Analysis (FVIA) system 
(Amidon & Flanders) utilizes a ten category coding which relates 
to the social climate of the classroom. This recording system 
facilitates analysis of the antecedents of verbal acts and assists 
inference as to possible cause-effect relationships. 

Outcomes 

Measurements of outcomes are classified as to classroom 
climate, i.e., classroom verbal behavior and student cognitive 
behavior. Classroom climate variables are the ten categories of 
the FVIA. The student cognitive behavior variables consist of 
physics content attainment and level of functioning in science 
processes and critical thinking. Appropriate standardized tests 
were selected for measurement of each of these variables. 
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Judgments 

Tr a data generated by measuring the selected behaviors 
wer e analyzed according to three statistical procedures: the 

analysis of variance, Darwin's Chi-square, and a test of medians 
Statistical decisions formed the bases for inference of relative 
effectiveness of each curriculum and the relationship of class- 
room verbal behavior to the inferred effectiveness. These infer 
ences constituted the decisions produced by application of the 
evaluation model . 
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Review of Related Literature 



Introduction 

The pux'pose of this section is to summarize previous 
rei : eh which is related to this study. The reported studies 

are -..-Duped into three categories* Science Curricula Studies, 

Ph^ _ .is Curricula Studies, and Classroom Verbal Behavior Studies. 
The atter is subsequently divided into a general section plus 
secucns on student outcomes in science and student outcomes in 
physics courses. 



Science C urricula Studies 

Several studies in the sciences (chemistry, biology, 
and €~xth science) have focused on the new curricular materials 
to determine what effect the curriculum has on the students 1 
achievement* A variety of criterion instruments have been used 
to - asure the dependent variables in comparing the achievement 
of students in the new curricula with those in a more traditional 
course. The criterion instruments were usually administered on 
a pre- and posttest basis to measure change in some aspect of 
cognitive science knowledge* 

A review of the literature indicates science educators 
lav., elected major components of cognitive science knowledge 
for evaluation in various ways. However, two components appear 
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consistently throughout the literature: science content and 

science processes. 

Content knowledge has been concerned with recall, rec- 
ognition, application of concepts, facts, and principles speci- 
fic to an area of science. Two types of standardized achievement 
tests are used to measure content knowledge. The first is to 
measure traditional science course materials (chemistry, biology, 
and earth science) and the second is to measure content specific 
to a curriculum such as Chemical Educational Material (CHEK) 

Study , Chemical Bond Approach (CBA) , Biological Science Curricu - 
lum Study (BSCS), and Earth Science Curriculum Project (EECP). 
Studies by Lisonbee (1964), Heath and Stickel (1963), Gennaro 
(1965), Kastrinos (1964), Lance (1964), Rainey (1965), Psycho- 
logical Corporation (1965), Champlin and Hassard (1966), 

Schirner (1967), and Troxel (1968) have utilized one or more of 
these two types of tests to measure content knowledge. 

Science processes are usually defined as understanding 
of scientific enterprise and critical thinking ability. Under- 
standing of scientific enterprise includes scientific attitudes 
and assumptions and the methods an i aims of science. The Test 
on Understanding Science (TOUS) by Cooley and Klopfer (1961) is 
one of the most frequently erployed instruments in measuring 
this aspect (Schirner; Troxel; and Thomas, 1968). 

The ability to think critically, a second major aspect 
of science processes, has been defined as the ability to recognize 
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and define a problem, clarify a problem by making appropriate 
definitions, ability to distinguish between facts and assump- 
tions, organizing pertinent information, formulating ana test- 
ing hypotheses, and stating tentative conclusions. The Watson - 
Glaser Critical Thinking Appraisal (WGCTA ) (Watson & Glaser, 

1964), has been used extensively as a measure of this aspect of 
science processes (Anderson, 1965; Kastrinos; George, 1965; 

Herron, 1966; Schirner ; Troxel). 

A variety of other instruments have been used to measure 

science processes ( Test on Science Knowledge , Cognitive Pref er- 
ence Test , and Kastrinos 1 Critical Thinking Test) . However, the 
selection of a particular instrument appears to be specific to 
the study (Kastrinos; Psychological Corporation; Champlm & 
Hassard; Schirner). 

The design most frequently used in analyzing student 
data has been analysis of variance in which pretests were used 
as a control for prior science knowledge. Other entry skills 
or individual differences of subjects controlled were academic 
aptitude (IQ), sex, and grade level. Although the analysis of 
vaiiance design prevails in science curriculum studies, one 
exception was noted. Herron used factor analysis to treat pre- 

and posttest data* 

Conflicting trends appear in the results of the science 
curriculum evaluation studies reviewed. These conflicting trends 
appear to be a function of the use of two types of standardized 
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achievement tests. When a traditional science achievement 
test is used in evaluating a new curriculum versus a traditional 
curriculum, the new curriculum results in as high or higher stu- 
dent achievement (Lisonbee; Gennaro; Kastrinos; Lance; Rainey; 
Marks, 1967; Troxel ) . When a specific curriculum achievement 
test (i.e., ESCP Achievement Test ) is employed in evaluation, 
traditional curricula appear to be at a disadvantage (Heath & 
Stickel; Lisonbee; Gennaro; Psychological Corporation; Schirner ) . 

One of the most consistent results revealed in the lit- 
erature is that of change in the ability to think critically. 
Students in a new curriculum tend to score as high or higher on 
the WGCTA than students in a traditional course (Kastrinos; 
George, 1965; Marks; Schirner; Troxel; Thomas). When compari- 
sons are made on achieving a greater understanding of the sci- 
entific enterprise the trend appears to be with the new curri- 
culum (Marks; Troxel; Psychological Corporation; Thomas;; 

Schirner ) . 

Physics Curricula Studies 

A search of the literature revealed several studies 
relating to physics achievement. The studies reveal the same 
trend for evaluation as the other sciences. The physics stu- 
dies attempt to determine what effect the physics curriculum has 
upon the students* understanding of physics content, understand- 
ing of science, and critical thinking ability. 



O 

ERIC 



S3 



20 



Several studies have evaluated the effect of a new 
physics curriculum versus a traditional course upon content 
achievement. These studies show that students in a traditional 
course achieve as high or higher on standardized achievement 
tests which were designed to test a broad knowledge of "classi- 
cal" or traditional physics than students in a new curriculum. 
Furthermore, the literature shows that students enrolled in a 
new physics curriculum or course score higher on achievement 
tests designed specific to that curriculum. Sawyer (1963) 
investigated tnis trend while attempting to measure the effec- 
tiveness of the Physical Science Study Curriculum (PSSC) program 
relative to traditional physics. A test was developed which 
included content items from both PSSC and non-PSSC materials. 

He concluded that PSSC program does not fulfill non-PSSC objec- 
tives and vice versa, and that the tendency for students taking 
such a combination examination would favor higher scores for 
non-PSSC students. 

Heath (1964) reported a study which found that tradi- 
tional high school physics classes achieved higher on a conven- 
tional test than PSSC classes. However, the PSSC classes per- 
formed in a superior manner on the PSSC Final Examination than 
did the traditional classes. A similar evaluation study was 
reported by Berry (1966). The Cooperative Physics Test and the 
PSSC Final Examination were used to test two groups. No sig- 



nificant difference in achievement was found between the groups. 
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however students in the PS SC physics course learned more of the 
essential subject matter content of PSSC physics than did stu- 
dents enrolled in the traditional physics (TP) course. 

Welch and Rothman (1968) conducted an evaluation of 
Harvard Project Physics (HPP) in which changes in physics 
achievement were measured for two groups. One group consisted 
of students who voluntarily enrolled for HPP and the other group 
consisted of students who were requested to register for HPP. 
There were no significant difference between the two groups as 
measured by the Physics Achievement Test for HPP. 

Niman (1970) developed and tested a set of materials 
that explored sophisticated physical ideas through the use of 
mathematical models of physics for teaching. To measure physics 
content, a final examination was prepared and administered to an 
experimental group and a control group. The experimental group 
was taught using the developed mathematical models. The study 
revealed that students in the experimental group performed sig- 
nificantly better on the physics test than the control group. 

The literature reveals that critical thinking is a 
major aspect of science processes to be evaluaced in physics 
curricular studies and that the WGCTA is the instrument used to 
measure this aspect. Three studies have shown that students 
enrolled in PSSC physics develop the ability to think critically 
to a greater extent than students of a TP course. Brakken 
(1965) factor analyzed tests and compared two groups in critical 
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thinking. He found that both TP and PSSC increased critical 
thinking, but PSSC accomplished it to a greater degree. Day 
(1964) and Rutledge (1965) also investigated change in critical 
thinking of PSSC and TP students. Both reported that students 
enrolled in PSSC physics developed into significantly better 

critical thinkers than those in a TP course. 

The TOUS and Science Process Inve ntory. (SPl) (Welch & 
Pella, 1968), are the most frequently used instruments for assess- 
ing change in understanding of science as a result of physics 
curricula. Two studies (Crumb, 1965; Trent, 1965) have inves- 
tigated PSSC and non-PSSC students' understanding of science as 
measured by the TOUS. Crumb compared students taught by PSSC 
physics teachers, both with and without formal PSSC training, 
and teachers of non-PSSC physics, both with and without rormal 
PSSC training. Results indicated that PSSC physics students 
score significantly higher than students in the non-PSSC course. 
Trent, using a different sample of PSSC and non-PSSC students, 
found no significant difference between PSSC and non-PSSC stu- 
dents' achievement as measured by TOUS. Both studies reported 
that adjustments were made for scholastic aptitude and prior 
science experience. Since the same student variables were con- 
trolled, it appears the difference could be attributable to 

uncontrollable teacher factors* 

Welch and Rothman, mentioned previously, used both the 
TOUS and SPI to measure change in understanding of science. 
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The study compared two groups ithin a new physics curriculum, 

HPP „ No significant differ jnces were found between groups. 

Niman, also mentioned earlier, nployed the SPI to measure 
understanding of science. There was no difference in achieve 
ment between experimental and control group as measured by the 

SPI. 

A search of the literature on physics curriculum stu- 
dies indicates that various comparisons have been conducted to 
determine the effect of traditional physics versus PSSC, or TP 
versus an experimental course. The selection of components for 
evaluation are the same as those revealed in other science cur 
riculum studies: content and processes. Several of the studies 

reviewed compared the effects of two curricula, TP and PSSC, but 
none reported an analysis of TP, PSSC, and HPP with r spect to 
physics content and science processes. 

Classroom Verbal Behavior Studies 

Researchers in education have recently begun to study 
the interactive verbal patterns of behavior of pupils and teach- 
ers in the classroom. Classroom verbal behavior constitutes the 
verbal discourse^ or talk which takes place between teachers and 
pupils and between pupils and pupils. Several observational 
systems designed to analyze pupil-teacher interaction m the 
classroom have been developed. The earliest observational stu- 
dies of classroom interaction began with the. work of Thomas & 
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others (1929); followed by those of Anderson (1939); Lewin, 
Lippitt & White (1939); and Withall (1940). 

Flanders (I960), who was influenced by the above men- 
tioned research, developed concepts of directness, indirectness, 
and flexibility to describe classroom verbal behavior. These 
concepts had their inception from social psychological theory. 
Flanders' system is designed to test the effect of social- 
emotional climate on student attitudes and learning. The sys- 
tem consists of ten categories for the analysis of teacher pupil 
verbal interaction. Flanders used the observational system to 
study teacher influence styles, pupil attitudes, and resulting 
achievement in seventh -grade social studies and eighth-grade 
mathematics. This study suggests that teachers who provided 
flexible influence styles from direct to the indirect depending 
on the situation were better able to create climates which 
enhanced student achievement. The students of those teachers 
who were less flexible in their teaching achieved at a lower 
level . 

Classroom Verbal Behavior and 
St udent Outcomes 

Since the early study by Flanders, several studies have 
investigated the relationship of patterns of teacher influence 
to pupil achievement in the schools. 

Furst (1965), using interaction analysis, found that 
above average student achievement was positively related to 
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indirect teacher influence, a moderate pace of teacher-pupil 
interaction, and an indirect teacher response to student talk. 

The study further revealed that the amount of student talk was 
positively related to student achievement. 

Perkins (1965), in a study concerned with under-achieve- 
ment with high-ability fifth graders, found that teacher lectur- 
ing and criticizing was related to loss in reading comprehension 
as measured by the California Achievement Test . Soar (1966) in 
a similar study, found that, indirect teaching produced greater 
growth in reading comprehension in elementary school pupils 
than direct teaching. Powell (1968) found the same trend when 
investigating the students' arithmetic achievement. 

Classroom Verbal Behavior and 
Student Outcomes in Science 
Curricula 

Science educators have recently recognized that the 
teacher's behaviors determine in part the favorable teaching- 
learning environment. The rapid increase in the number of science 
teacher behavior studies and interaction studies in the last five 
years is evidence of this increasing awareness. A survey of the 
teacher behavior and interaction research reveals that many 
researchers are investigating the relationship between descrip- 
tions or patterns of teacher behavior to criterion measures such 
as pupil attitudes and pupil achievement. 

Parakh (1968) used a modified Flanders Verbal Interaction 
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biology teachers. He found a relatively low percentage of 
student verbal participation, especially student initiated con- 
tribution, compared with a high percentage of direct verbal 
teaching procedures used by most of the teachers in the study. 
The investigator did not attempt to make any evaluation state- 
ments about the teaching behavior patterns observed. 

In another biology research project Gold (1966) inves- 
tigated the verbal behavior of selected biology teachers. The 
teachers effectiveness was determined by scores on three instru- 
ments. The instruments were Teacher Rating Scale . Student Opin - 
ion Questionn aire , and Teaching Situation Reaction Test . The 
verbal interaction of the classroom was classified by a sixteen- 
category system developed by Hough (1967 ). Re_.. _s indicated 
that the overall patterns of classroom behavior for two selected 
groups were not the same . 

Schir.ner used FVIA to ascertain the directness or indi- 
rectness (ID ratio) of a teacher's pupil-teacher interaction in 
various teaching activities in earth science classes (ESCP and 
non-ESCP). To establish effectiveness, he used measured stu- 
dent outcomes on a set of criterion instruments. These instru- 
ments included TOUS , WGCTA, Test of Science Knowledge; Parts I 
and II , ESCP-Final , and Earth Science Final . He also measured 
the teacher's expressed philosophical orientation (TNT ratio). 

A Credo Pref erence Check List was constructed to determine the 
The findings indicated the compatibility of the 
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factors ::api esent id by ID ratios, TNT ratio, and the type of 
course led to significantly greater achievement in most suuderit 
outcomes. A student who has a teacher that is direct and has 
traditional beliefs has an advantage if in a non-ESCP course and 
is at a disadvantage if in an ESCP course. If a teache" is 
indirect and has nontradit ional beliefs, a student has an advan- 
tage if in an ESCP course and is at a disadvantage if in a non- 
ESCP course. 

Evans (1968) investigated the relationship between 
teacher verbal behavior and pupil achievement over a three-year 
period with one teacher, and over another year period with the 
same pupils under a different teacher. The teacher behaviors 
Were quantified through the FVIA system. The sample consisted 
of elementary children. He concluded that pupils under indi- 
rect teachers scored higher on Science Research Associates 
Achievement ( SRA) tests than did pupils after three years of 
direct teaching. Examination of fourth-year scores indicates 
that some pupils, after three years of direct teaching, gained 
more in the fourth year than did those pupils with three years 
of indirect teaching. The author concluded that the measured 
differences in classroom climate were not related to pupil 
achievement and if the study had been restricted to the first 
three years of schooling then indirect teaching facilitates 
pupil achievement. 
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Citron & Barnes (1970) designed a study to gather sta~ 
dstical evidence to prove or disprove whether or not certain 
patterns of teaching were better than others for slow learners 
in biology at secondary school level. Achievement was measured 
in three areas: concept formation , problem solving, and total 

performance. The classroom observation instrument used to mea- 
sure and verify prescribed patterns of teaching was the FVIA. 

The curriculum applied to all of the classes in the study was 
"Patterns and Processes" published by BSCS. The tests used to 
measure achievement were unit tests used with "Patterns and 
Processes » " The conclusions reached from the study include: 

(a) a high indirect to direct teaching ratio (high I/D) early 
in the course for slow learners followed by a lower I/D ratio 
later in the course increases achievement in problem solving 
and in total performance, provided problem solving plays a major 
role in total performance; and (b) a constant intermediate I/D 
ratio throughout a course of biology for slow learners leads 
to a higher achievement in concept formation than does a change 
in I/D ratio in either direction from the start to the end of 
the course. 

Evans & Balzer (1970) developed a category system 
based upon actual descriptions of teacher behaviors and then 
used the coding system to obtain an objective description of 
the classroom behaviors of a sample of biology teachers. The 
instrument „ Biology Teacher Behavio r Inventory (BTBI), was 
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developed from video tape recordings of eleven biological 
science teachers. An analysis of the data revealed that when 
the behaviors of all the teachers taken together, over 94% of 
them pertained either to management or content development of 
the biology class. 

Classroom Ver bal Behavior and 
Student Outcomes in Physics 
Curricula 

A search of the literature revealed two relevant studies 
involving the classroom behavior of the physics teacher and 
their students. The primary concern of these two studies was to 
relate behavior patterns to teaching effectiveness. 

In the first study, Snider (1966) investigated a sample 
of 17 physics teachers in the New York State Regents Physics 
Course and their students. Flanders' method was used to describe 
physics teaching in terms of pupil— teacher verbal interaction 
on the directness of teacher influence dimension and to seek 
relationships between teacher effectiveness and both directness 
and flexibility of teacher influence. The teaching activities 
were segmented into Planned Demonstration, Lecture, Laboratory 
and Recitation— Discussion. Three selected aspects of student 
achievement were measured with paper-and-pencil tests. The 
results showed that matrix measures were, in effect, measures 
of teacher style and that style varied from one major activity 
to another. He found that the employment of social skills 



O 

ERIC 



43 



30 



O 

ERIC 



connected with aspects of positive motivation is an uncommon 
phenomenon in the high school physics classroom, physics teach- 
ers rarely build on student ideas, and there appeared to be 
relatively little learning through discovery in physics class- 
rooms. Furthermore, no single directness or flexibility measure 
appeared as a factor of teacher effectiveness for all aspects 
of effectiveness considered. This dependent variable of effec- 
tiveness was inferred from the achievement measures. 

In a second research project, Pankratz (1966) investi- 
gated a population of 30 physics teachers from 30 separate 
high schools in Columbus and Dayton, Ohio. A Teacher Rating 
Scale , Student-Opinion Questionnaire , and a Teaching Situation 
Reaction Test were instruments used to measure teacher effec- 
tiveness. The five highest and five lowest ranking teachers 
according to the three evaluative instruments comprised a high 
and low sample which were observed* Using the Observa t ional 
System for the Analysis of Classroom Instruction developed by 
Hough the researcher classif isd and recorded verbal classroom 
behavior. The following cone usions were drawn from the data 
analyzed: (a) teachers who rated high on the evaluative instru- 
ments used more praise and reward, more cognitive and skill 
clarification and acceptance than teachers rated low; (b) indi- 
rect influence as compared with direct influence was employed 
by the high group significantly more often and in a more sus- 
tained manner; (c) the sustained use of student's ideas and the 
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length of teacher's answers to students' questions was greater 
for the high rated group, (d) each of the two groups used 
approximately one-half of their time in lecturing; and (e> the 
high rated group used more indirect influence patterns, whereas 
the low sample emphasized direct influence patterns to a 
greater degree. 

Summary 

. a survey of the literature relating to science (chemi- 
stry, biology, and earth science) curricula and specifically 
physics curricula leads to several general conclusions. Science 
educators have selected two components of cognitive science 
knowledge for evaluation. The two components of science content 
and science processes appear consistently throughout the litera- 
ture. These two components selected for measurement are the 
same as the common objectives of science instruction identified 
by the model. In measuring these objectives, conflicting 
trends appear in student outcomes. The conflicts appear to be 
a function of the use of two types of standardized achievement 
tests used to measure science content and science processes. 

When a traditional achievement test is used in evaluating a new 
curriculum versus traditional curriculum, the new curriculum 
results in as high or higher student achievement. When a spe- 
cific curriculum achievement test is used in evaluation, the 
traditional curriculum appears to be at a disadvantage. Another 
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factor which may contribute to the conflicting trends it lack 
of uniform control of entry skills. These findings tend to 
support the necessity of the formative experiences component of 

the evaluation model. 

Other studies stressed the importance of the teachers' 
verbal behavior in the teaching- 3 earning environment. Several 
studies in science have investigated the relationship between 
patterns of teacher verbal behavior in various curricula and 
pupil achievement. 

Results would indicate that science teachers, as a 
group, tend to be more direct than indirect in their classes 
and students' verbal participation is relatively low when com- 
pared to the teacher's. Trends further indicate teachers spend 
the majority of class time in content development. The effect 
of such behavior has been revealed in two physics studies. The 
two studies agreed that physics teachers rarely build on stu- 
dent. ideas, that there is relatively little learning through 
discovery, and that nearly one-half of the class time is spent 
in lecturing. Conflicting results were reported with respect 
to the relationship of student achievement with teacher direct- 
ness or indirectness. This conflict may have resulted from the 

restricted sample of the studies* 

The present study investigated this conflicting and 
relatively unexplored area of verbal benavior of teachers within 
three physics curricula (TP, PSSC, and HPP) and the relationship 
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to student outcomes „ The transactions component within the 
evaluation model represents this relationship through the use 
of the student-teacher-curriculum triad. The following section 
will identify the method and procedures for selecting and mea 
suring key variables within the various components of the eval- 
uation model . 
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Method : 



Application of the Model 



The purpose of this section is to present a descrip- 
tion of the method used in applying the evaluation model to 
the physics curriculum. This application includes the follow- 
ing components: selection and description of sample, selection 

and description of measuring instruments, selection and descrip- 
tion of an observational instrument, and the procedures of col- 
lection and analyses of data. 

Selection and Description of the Sample 

The subjects used in this study were 26 teachers and 
954 pupils selected from approximately 150 schools which taught 
a traditions) physios (TP) course, Physical Science Study Cur- 
riculum ( PSSC ) , or Harvard Project Physics (HPP) course during 
the 1968-1969 school- year. In the summer of 1968 a letter 
[Appendix a] , including a questionnaire, was sent to approxi- 
mately 600 Texas schools and National Science Summer Institutes 
across the United States. From the responses, only those 
schools that taught the TP, PSSC, or HPP curriculum were consid- 
ered for sampling. The random sample consisted of 24 schools 
throughout 7 states with 38 classes containing 954 physics stu- 
dents in grades 5 through 12. Table 1 shows the number of 
schools in each physics curriculum, the number of students of 
each sex and the total number of teachers and students in the 
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study. [a 

included in 


listing of the schools and 
Appendix bJ] 

TABLE 1 

Numerical Description of 


their locations is 
the Sample 


Physics 




Students 






Curriculum 


Males 


Females 


Tot al 


Teachers 


TP 


195 


52 


247 


8 


PSSC 


289 


94 


383 


10 


HPP 


241 


8 3 


324 


8 


Total 


725 


229 


954 


26 



Measures of academic aptitude were secured from each 
student's cumulative record on file in his school in order to 
eliminate the necessity of administering an additional test 
during the study. Since only the most recent measure on each 
student was used, a total of 13 different test scores were used. 
Those tests used to measure academic aptitude (IQ) were the fol- 
lowing: (a) Differential Aptitude est , (b) P reliminary Scho - 

lastic Aptitude Test , (c) American College Test , (d) Collegg 
Entrance Examination Boar d, (e) Test of Academic Progress , (f) 
Otis. Gamma , (g) Iowa Test of Educational Development , (h) 

Henmon— No Is on Test of Menta l Abi lit ie s , (i) i. tiona j. Meri t Schol- 

arship Examination , (j) O h i o State Psychological Pv-- • minaj:.von_, 

(k) California Test of Mental Maturity , (3 ■ \V"ic. ■' - Researc h 
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Associates Test Battery , and (m) Lor qe-Thorndike Intelligence 
Test . Verbal and numerical scores were secured from those tests 
that did not render a composite score; such scores were then 
converted to composite standard form to provide a basis for 
comparison. The raw scores from the 13 separate tests were con- 
verted to stanine form by using a normal pet. ile chart. To 
be directly comparable, each of the 13 tests should have their 
stanine conversions based on the same pupil population. How- 
ever, each test had been standardized over representative popu- 
lations of pu vi 1 s and therefore should be comparable for a 
large population. Stanines are standard scores having a mean 
of five and a standard deviation of two. While stanine scores 
lack the precision of some other types of standard scores, it 
was judged that the compilation of different test results for 
different students would make this less precise fomr of 'S'cor e 
the most appropriate for this study. 

The sample, while typical of the population of high 
school physics students, is not typical of the high school pop- 
ulation as a whole. The sample in this study had a mean stanine 
of 6.71 with a standard deviation of 1.58. The academic apti- 
tude of the sample is somewhat higher and less variable than 
that of the high school popula ion at large; this finding was 
not unexpected. 

Though all pupils were tested six times during the 
year (three ore- and three posttests) relatively little informa- 
tion was missing on any one student. Complete data were available 
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for about 96% of the total sample. The mean of each variable 
for each class was computed and inserted in the place of a 
missing value. It was judged that approximately 4 % missing 
data, due to absences, withdrawals, and other causes, was reia 
tively low for a study of this type. 

Selection of Tes ts 

Three criterion instruments were selected in an attempt 
to examine different types of learning: physics content 

achievement, understanding science processes, and critical think- 
ing. The Dunning- Abe les Physics Achi ev ement Test, , gormj (DAPT) 
(Dunning & Abeles, 1967) was used to measure physics content 
and concepts. It attempts to measure physics course content 
and concepts representative of any curriculum, new or traditional 
The test contains 50 multiple choice questions; its reliability 
coefficient of 0.87 was determined by the split-half method as 
reported in its manual. Form E of the test has a mean of 25.5 
and a standard deviation of 8.6. The test purports to measure 
five content and concept areas of physics; these areas are 
mechanics, electricity and magnetism, atomic and nuclear physics, 
wave motion and light, and kinetic-molecular theory. There are 
questions concerned with knowledge, understanding, and applica 

tion i each of the five areas. 

The Wisconsin Inv entory of Sci ence Processes (WISP) was 

used to measure knowledge of the scientific enterpxise. 
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test items are concerned with the assumptions, activities, 
objectives, and products of science. The test consists of 93 
multiple choice questions and has a mean of 54.2 for a sample 
of twelfth-grade high school students. The instrument has a 
reliability of 0.8 2 using Kuder-Richardson For; -’.a 20 , as 
reported by the Scientific Literary Research Center at the Uni- 
versity of Wisconsin. 

The Watson— Gl a ser Critical Thinking Appraisal (WGCTA) , 
(Watson & Glaser, 1964) consists c a series of test exercises 
which require the application of some of the important abilities 
involved in critical thinking. The test contains 100 multiple 
choice questions. It contains five subtests designed to measure 
aspects of critical thinking. The WGCTA, Form YM , has an odd-even 
split— half reliability of 0.87. This coefficient was corrected 
by the Spearman- Brown formula. The five subtests of the WGCTA 
are (a) Inference (20 items), (b) Recognition of Assumptions 
(16 items), (c) Deductions (25 items), (d) Interpretation (24 
items), and (e) Evaluation of Arguments (15 items). 

Four other variables describing formative experiences 
were also included in the analysis: academic aptitud , sex of 

the student; curriculum, and grade level of the student* 

Observa t ional Inst xm men t 




The Flanders Verbal Interaction Ana lysis (FVIA) system 
utilizes a ten category scheme for classifying interaction data. 

l o 2 
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The ten categories can be grouped into three broad division-. 

(a) teacher-talk, (b) student-talk, and (c) silence or confu- 
sion. Teacher-talk is divided into two types of influence, 
indirect and direct. The indirect influence consists of four 
categories : 

1. Accepting feeling, 

2. Praising or encouraging, 

3. Accepting or using. ideas of students, and 

4. Asking questions. 

The direct influence consists of three categories: 

5. Lecturing, 

6. Giving directions, and 

7. Criticizing or justifying authority. 

The student-talk is divided into two categories: 

8. Student response, and 

9. Student initiation. 

Category 10 is classified as silence or confusion and defined 
as those pauses of silence and periods of confusion in which 
the verbal behaviors cannot be understood by an observer or coder 
(Descriptions of the scoring categories and a sample Interaction 

Matrix Form are shown in Appendix ci] 

Flankers developed a matrix technique which allows for 
the preservation of the sequential nature of the data. In the 
matrix, the rows and columns are numbered according to the num- 
bers of the categories of the Flanders system described above. 
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Each numeral recorded on the coding sheet (an event or category 
is recorded every three seconds) is paired with the numeral 
immediately following it and the number pair tabulated i to the 
matrix, the first number of the pair indicated the row and the 
second number the column into which the pair of numerals will go. 



Procedures 



Administration of Tests 

Pretests of the DAPT, WGCTA, and WISP were administered 
to the subjects in September, 1968. Posttests using the same 
instruments were administered in May, 1969. 

The teachers within the various physics curricula admin- 
istered the criterion battery of tests during regular class 
periods in which a three-hour period of time was utilized. Each 
teacher received identical written instructions pertaining to 
the testing procedures, to follow during test admir 'tiation. 

The tests were sequenced in the same manner for all classes dur- 
ing the pre- and posttesting. All subjects were tested using 
the three measures for determining course effectiveness. 

Measuring Classroom Verbal 
Behavior 

Classroom verbal behavior which occurred in the physics 
classrooms of the subjects was recorded on audio tape to permit 
analysis of the ongoing verbal behavior. Regular classes were 
recorded four times during the 1968-1969 academic year for 
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subsequent coding using the FVIA. The tapes were analyzed 
using the ten categories previously listed; the pupil-teacher 
verbal behavior was sampled and recorded at three-second 
intervals. This procedure produced sequences of numbers that 
represented the original sequences of verbal events or inter- 
action of categories that took place in the classroom. After 
each tape had been coded, the numbers were tabulated in a 
10 x 10 square matrix. Individual classroom verbal interaction 
matrices were combined to form composite matrix of multiple 
classes; matrices of the classrooms were compared in iwo 
ways: first, composite verbal interaction matrices were 

formed— one each for the TP, the PSSC, and the HPP classes; 
and second, composite verbal interaction matrices were formed 
from the highest and lowest scoring classes based upon com- 
posite achievement. The highest and lowest classes were 
determined by selecting the highest and lowest 21 % of all 
classes in the sample, thus yielding maximum discrimination 
(Kelly, 1939). These two sets of composite matrices were then 
compared on an intra-set basis to assess any differences that 
might exist in the overall interaction pattern for the ten 

- U 

categor ies of behavior. 

A comparison was made among the three curricula using 
only the highest scoring classes in an effort to assess differ 
ential patterns for classrooms showing the highest composite 
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achievement. Comparisons were alsi m . & oi individual class- 
room matrices for the three curricula and for the total high 
versus low scoring classes to determhn if there were any dif- 
ferences with respect to the followixig. 

1. The percentage frequencies in each of the ten 
categories . 

2. The indirect-direct (I/D) ratio. 

3 . The teacher-talk ratio. 

4. The student-talk ratio. 

5. The content ratio. 

Computational formulas used to compute individual .values 
for the comparisons of ratios are given in figure 3. 



Ratio 



Computational Formula 



Indirect-direct ratio 
Teacher-talk ratio = 
Student-talk ratio = 
Content ratio = 



Sum of tallies i n columns 1 thru 4_ 

Sum of tallies in columns .1 thru 7 

Sum of tallies in columns 1 thru 7 

Total number of tallies in matrix 

Sum of tallies in columns 8 thru 9 
Total number of tallies in matrix 

Sum of tallies in columns 4 thru 5 
Total number of tallies in matrix 



Figure 3 

Formation of Classroom Verbal 
Behavior Ratios 




Z ~ t a bi ishing Cod er 

Reli ability 



p-'evi 
data gathered 



us studies by Flanders and others have shown 
by means of interaction analysis are no more 
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than the reliability of the coders. Prior to analyzing the 
tapes recorded in the classrooms, the two coders used Flanders' 
training tapes containing classroom sessions which provided var- 
iability of categories. They trained approximately ten hours 
before coding the tapes used in this study. 

A method for establishing inter-coder reliability was 
developed by Scott (1955). Scott calls his reliability coeffi- 
cient "pi 1 ' ( TT ) and it is determined as 

P - P , 

o e „ where 



7T = 

e 

P is the proportion of agreements between coders and P g is the 

0 

proportion of agreement expected by chance, which is found by 
squaring the proportion of tallies in each category and summing 
those over all categories, such that 

k 2 

P ■= H F , where 

e i— 1 i 

P. is the proportion of tallies falling into each of the k cate- 

1 

gories. 7T can be expressed in words as the amount that two 
coders exceed chance agreement divided by the amount that perfect 
agreement exceeded chance. A Scott TF of 0.85 nr higher has been 
designated as a reasonable level of performance- 

In this study a coefficient of 0.98 was established 
between the coders; data on which TT was based are presented in 
Table 2. _ 
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TABLE 2 

Calculation of Coder Reliability Using the Scott Method 
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Statistical Techniques 

A 3 x 3 x 2 mixed factorial design (curricula, tests, 
pre-post) with repeated measures on two factors was used to ana- 
lyze the pre- and posttest data. To satisfy the basic assump- 
tions of the analysis of variance ( AN OVA ) design. Hartley's 

F -test (Winer, 1962) was used to test for homogeneity of 
—max. 

variance. All test scores for each criterion instrument were 
converted to standard scores to obtain equivalent scaling for 
the analysis of data. An XDS Sigma-7 computer, using a 3 x 3 x 2 
mixed factorial design written specifically for the study, was 
employed in the analysis. The Scheffl a poster! tests (Winer) 
were used to determine between which means there was a signifi- 
t ffc-ence. Correlations between the variables of grade 
level, academic aptitude, sex, and test scores (pre-post) were 
computed to measure their degrees of interrelationship. 

The Darwin Chi-square test (1959) was used to compare 
the total FVIA patterns for the three physics curricula. All of 
Darwin’s analysis is based on the assumption that interaction 
sequences are one-dependent, or Markov chains, which is a better 
approximation than the zero-dependent assumption of the Chi- 
square. Darwin contends that communication events are, in fact, 
more than or.e-dependent , but the additional dependence of three 
or more events is small by comparison to the dependence between 
two events. The Kruske 1-Wall is H-test and Mann-Whitney U-test 
(Siegel, 1956) were used to make comparisons between variables 
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of the FVIA matrices. All tests of significance were made at 

the .05 level of significance. 

In summary, the statistical techniques employed in the 

present study included the following: 

]_ a Pearson's product-moment correlation to measure 

the relationship between two variables. 

2. ANOVA, three-factor mi'-ed design with repeated mea- 
sures on two factors (3x3x2 design) . 

3 Hartley 1 s F -test for homogeneity for variances. 

* 2 — max. 

4. Scheffe method for determining significan differ- 
ences between means. 

5. Darwin Chi-square test for determining significant 
differences among total FVIA patterns of the three physics cur- 
ricula. 

6. Kruskel-Wallis H-test for determining differences 
between variables of the FVIA matrices in comparing three groups. 

7. Mann— Whitney U— test for determining differences 
between variables of the FVIA matrices when comparing two groups. 



Hypotheses 
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The following specific null hypotheses were tested. 

I . There are no significant differences among composite 
achievement scores for the three physics curricula. 

II. There are no significant differences in achievement 
among tne three curricula for each of the achievement measures, 
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i.e., no significant statistical interaction exists between 
curriculum and tests. 

There are no significant differences among composite 
verbal interaction matrices for the three curricula with respect 
to the total interaction pattern for all ten categories. 

IV. There are no significant differences among the class- 
room verbal interaction matrices for the three curricula with 
regard to : 

1. The percentage frequencies in each of the ten 
categories. 

2. The Indirect-Direct ratio. 

3. The teacher-talk ratio. 

4. The student-talk ratio, 

5. The content ratio. 

V. There is no significant difference between the high 
and low scoring classroom composite verbal interaction matrices 
w ith regard to the total interaction pattern for all ten cate- 
gories. 

Vi. There is no significant difference between the class- 
room verbal interactions matrices for the high and low scoring 
classes with regard to : 

1. The percentage of frequencies in each of the ten 
categories . 

2. The Indirect-Direct ratio. 

3. The teacher-talk ratio,. 
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4. The student-talk ratio. 

5. The content ratio. 

VII. There are no significant differences among the 
classroom verbal interaction matrices for the high scoring 
classes of the three curricula with regard to: 

•1 „ The percentage frequencies in each of the ten 
categories . 

2. The Indirect-Direct ratio. 

3. The teacher-talk ratio. 

4. The student-talk ratio. 

5. The content ratio. 



S ummary 




The evaluation model was applied to a sample consisting 
of 954 students enrolled in 38 classes taught by 26 teachers. 
This sample was randomly selected from approximately 150 school 
which taught TP, PSSC, or HPP during the 1968-1969 school year. 
The sample may therefore be considered representative of the 
three curricula. 

The behavioral goals component within the model identi- 
fied two major areas of knowledge to measure: physics content 

and science processes. These goals were measured by a battery 
of three tests (physics content, science process, and critical 
thinking) selected and administered twice, before and after an 
interval of time, to three groups. Formative experiences, the 
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second component, were included in the student information and 
subsequently in the analysis of data. Academic aptitude, sex 
of the student, curriculum, grade level, and pretest scores 
were the controlled entry skills for each student. 

Within the transactions component, containing the teach 
inq triad, classroom verbal behaviors of students and teachers 
within the three curriculum were quantified using the FVIA. 

The classroom verbal behavior patterns were then analyzed and 
related to composite (content, processes, and critical think- 
ing) student outcomes, the fourth component of the model. 

Based upon the analysis of data, judgments were formu- 
lated concerning the effects of classroom verbal behavior upon 
student outcomes within the three curricula. The following 
section presents the data analysis, results, and interpreta- 
tions . 
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Data Analysis, Results, and 
Interpretation 
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The purpose of the previous section was to present a 
description of the method used to apply the model, following 
that, the present section presents the analyses of data, results, 
and interpretations. The section is divided into three major 
divisions: analysis of test data, analysis of classroom verbal 

behavior, and summary. Within each analysis section, the rele- 
vant hypotheses are discussed. 

Analysis of Test Data 

The principal method of test data treatment was the 
analysis of variance. In order to form a composite score for 
the three tests, it was necessary to convert the raw data from 
pre- and posttesting. into standard scores. C^he class raw score 
means are presented in Appendix G.U A simple z-t^ansformation 
was performed to achieve equivalent scaling across the three 
instruments since each had a different mean and variance. The 
standard scores resulting from the transformation had a mean of 

50 and a standard deviation of 10. 

To satisfy the basic assumptions of the design. Hartley's 

F -test (Winer 1962) was used to test for homogeneity of 

—max. ' 

variance. The F-ratio of test variances between the curricula 

was less than the critical value of the .05 level; therefore, 

' 
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the data were assumed to meet the requirement of eguivariance. 
Since the data showed homogeneity of variance, a test for nor- 
mality of distribution was not conducted. Results reported by 
Box (1954) and Norton (Lindquist, 1953) have indicated that for 
unequal sample sizes, the data should be tested for eguivariance 
and, if this proves tenable, the analysis of variance may be 
continued without further tests of assumptions. 

The data were then treated to determine if formative 
experiences or entry skills of the students were significantly 
different for the several levels of the dependent measures. The 
variables of grade level, academic aptitude, and sex of the stu- 
dent were correlated with test scores, using the Pearson product 
moment correlation technique. C These correlation coefficients 
are presented in Appendix F.3 Results indicated that test change 
scores could not be attributed to formative experiences. Since 
the formative experiences were not significantly different, the 
data were analyzed using the analysis of variance, the results 
being summarized in Table 3. Xt may be noted that four of the 
mean square ratios were found to be significantly higher than 
chance expectancy at the .05 level, resulting in significant 
F-values. Since the interaction of the tests and the pre-post 
dimension were found to be significant, the lower order niain 
effect for the pre-post dimension is included in the interactive 
comparison and was not subject to additional analysis. 
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TABLE 3 

Summary of Analysis of Variance for Student Outcomes 
on Evaluation Instruments 



Source of Variation 


SS 


df 


ms 


F 


Total 


635,904 


5723 






Between Subjects 


(310,712) 


(953 ) 






Curricula (C) 


9,695 


2 


4847 


15.315* 


Error, 

b 


30'., 017 


951 


317 




Within Subjects 


(325,192) 


(4770 ) 






Tests (T) • — 


0+ 


2 


0 




Pre-Post (PP) 


28,818 


1 


28,818 


536.361* 


Interactions 










C X T 


361 


4 


90 


1.193 


C X PP 


451 


2 


226 


4.197* 


T X PP 


25,165 


2 


12,583 


318.561* 


C X T X PP 


236 


4 


59 


1.494 


Error , 
wl 


143,940 


1902 


76 




Error ' 
w2 


51,096 


951 


54 




Error^^ 


75,125 


1902 


39 




*p < .05 










Between- test 

process . 


variability 


removed 


during rescaling 
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Relative to Hypothesis X, significant differences among 
composite achievement change scores for the three physics 
courses were found (p<.05). Figure 4 includes graphic repre- 
sentations from which it can be seen that Physical Science Study 
Curriculum (PSSC) was superior to traditional physics (TP) and 
Harvard Project Physics (HPP) on the composite pretest. There 
was no difference between TP and HPP on the composite pretest. 
This same ordering was found on the composite posttest. For TP, 
the composite pretest mean was 46.50 with a composite posttest 
mean of 50.66, producing a change score of 4.16. PSSC had a 
composite pretest mean of 49.53 with a composite posttest mean 
of 53.59, a change of 4.06. The composite pretest mean was 
46.62 for HPP, and the composite posttest mean was 51.86, yield- 
ing a change score of 5.24. Although each curriculum showed 
significant gain from pretesting to posttesting, there was no 
.evidence of difference in composite change scores at the .05 
level among the three physics courses. 

Significant differences were found among the composite 
(combined student scores from three curriculum) scores of the 
physics achievement test, Dunn ing- Abe l e s Physics Achievement 
Test. For m E (DAPT)* critical thinking test, Watson-Glaser 
Critical Thinking Appraisal (WGCTA) ; and science processes, 
Wisconsin Inventory of Science Processes (WISP), In Figure 5 
is displayed a pretest mean of 49.56 for the WGCTA which is not 
statistically different from the WISP pretest mean of 48.89. 
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The WGCTA pretest mean of 49*36 was significantly greater than 
the DAPT pretest mean of 44.82 and the WISP pretest mean of 
48.89 was significantly greater than the pretest mean of 44.82 
on the DAPT. The pretest means may then be ordered from high 
to low as follows: The WGCTA and WISP pretest means were equiv- 

alent and significantly larger than the DAPT pretest mean, 

((WGCTA = WISP) > DAPT). A reversal of the ordering of the three 
means was found on posttest results. The DAPT posttest mean 
was significantly larger than the WGCTA and WISP posttest means, 
which again were not found to differ (DAPT> (WGCTA = WISP)). 

The DAPT mean scores resulted in a positive change score 
of 10.37 (Pretest mean = 44.82, Posttest mean = 55.18). The 
WISP change score (2.22) was also positive (Pretest mean = 48.89, 
Posttest mean = 51.11). The WGCTA had a positive change score of 
0.88 (Pretest mean = 49.56, Posttest mean = 50.44). There was 
a significant gain between pretesting and posttesting for each 
test at the .05 level. The DAPT change score of 10.37 was sig- 
nificantly greater than a change score of 2.22 on the WISP- and 
a change score of 0.88 on the WGCTA. The change score of 2.22 
on the WISP was significantly greater than the change score of 
0.88 on the WGCTA. The relative changes on the tests may be 
ordered as follows: The DAPT change was greater than WISP 

change, which was in turn greater than WGCTA change, all changes 
being positive (DAPT change > WISP change > WGCTA change). 
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The interaction between curricula and individual tests 
was not statistically significant^ this findj.ng led to the 
default acceptance of the null statement of I-Iypothesis II. 

Analysis of Classroom Verbal Behavior 

Three methods of analysis were used to make comparisons 
of the classroom verbal interaction matrices. Darwin's Chi- 
square technique was utilized to compare total verbal interaction 
patterns of a matrix. The Kruskel-Wallis II-test was utilized 
to compare individual categories among three curricula. The two 
composite verbal interaction matrices (high scoring classes 
versus low scoring classes) were analyzed by the Mann— Whitney 
U-test to discriminate among the individual categories of the 

matrices. ; 

The matrix comparisons are presented in the following 
sequence: comparison of the three verbal interaction matrices 

composed of TP, PSSC, and HPP classes and then an analysis of 
the two high and low scoring class verbal interaction matrices, 
with additional analyses of high scoring classes. 

Hypothesis III was concerned with the differences among 
composite verbal interaction matrices for the three curricula 
■wj_th respect to the total verbal interaction pattern for all 
ten categories. This hypothesis was evaluated by analyzing the 
total classroom verbal behavior for the three physics curricula, 
based upon the formation of composite matrices from individual 
verbal interaction matrices. £ Com P os; *- t e mat rices of the TP, 
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PSSC , and HPP classes, respectively, are displayed in Appendix 
D 7j The result of applying Darwin’s Chi-square technique indi- 
cated differences at the .05 level in the total verbal inter- 
action patterns among the curricula. This finding resulted in 
the rejection of the null form of Hypothesis III. 

Hypothesis IV dealt with the differences among the class- 
room verbal interaction matrices for the three curricula with 
regard to the percentage frequencies in each of the ten cate- 
gories, and the differences among the classroom matrices for 
the three curricula with regard to four selected aspects of ver- 
bal interaction. The hypothesis was tested in two segments. 

Table 4 presents the percentage frequencies of the ten Flanders 
categories for the three curricula and the Kruske 1-Wall is H— 
values for each comparison. Table 5 presents the mean ratios 
for the selected aspects of classroom verbal behavior among the 
three physics curricula and the respective Kruskel-Wallis re- 
values. The application of the Kruskel-Wallis H-test to both 
the ten categories and the four selected aspects did not yield 
evidence of differences among the physics curricula with respect 
to these variables. Therefore, the null statement of Hypothesis 
IV was not rejected. 

Hypothesis V was concerned with the difference between 
the high and low scoring classroom composite verbal interaction 
matrices with regard to the total interaction pattern for all 
ten categories. The composite matrix for the ten highest scoring 
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‘TABLE 4 

Comparisons of Curricula on the Percentage 
Frequencies in the Ten 
Flanders Categories 



Flanders Category 


Mean 

TP 


Percent age 
PSSC 


HPP 


H-value 


1 


0.00 


0.05 


0.07 


1.07 


2 


2.18 


1.36 


2.78 


0.11 


3 


7.38 


6.14 


2.38 


2.09 


4 


6.18 


10.99 


4.78 


0.69 


5 


56.30 


38.87 


69.62 


4.98 


6 


1.73 


0.99 


1.11 


5.14 


7 


0.30 


0.72 


0.35 


1.68 


8 


3.21 


10.96 


4. 22 


1.64 


9 


14.73 


13.13 


7.55 


3.44 


10 


8.00 


11.93 


7.14 


2.81 



n*b. values for H must equal or surpass 5*99 to be 
significant at the *05 level. 
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TABLE 5 

Comparisons of Selected Flanders Aspects of 
Classroom Verbal Interaction in 
Three Physics Curricula 



Mean Ratio 



Flanders Aspect 


TP 


PSSC 


HPP 


H-value 


Indirect-Direct Ratio 


0.23 


0.31 


0.18 


2.85 


Teacher-Talk Ratio 


0.73 


0.57 


0.78 


5.25 


Student-Talk Ratio 


0.19 


0.24 


0.14 


2.37 


Content Ratio 


0.62 


0.48 


0.70 


3.92 



rujb. values for H must equal or surpass 5.99 to be 
significant at the .05 level. 



classes was based on composite achievement scores disregarding 
curriculum. The composite matrix for the ten lowest scoring 
classes was calculated in a parallel manner. (jThese composite 
matrices are presented in Appendix E.] Application of Darwin's 
Chi-square technique indicated that the two total interaction 
patterns were significantly different (p<.05). Thus, the null 
statement of Hypothesis V was rejected. 

Hypothesis VI dealt with the differences between the 
high scoring and low scoring composite verbal interaction 
matrices with respect to the percentage frequencies in each of 
the ten categories, and four selected aspects of classroom ver- 
bal behavior. The mean percent^-^e frequencies and the Mann- 
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Whitney U-va^ues for the ten categories are presented in Table 
6* The mean ratios and Mann-W'nitney U-values for the four 
selected aspects are presented in Table 7. The application of 
the Mann-Whitney U-test did not provide evidence of differences 
between the high and low scoring classes for the ten categories 
of verbal interaction or evidence of differences between the 
high and low scoring classes as to the four selected aspects of 
classroom verbal behavior . These findings led to the default 
acceptance of the null statement of Hypothesis VI. 

TABLE 6 

Comparison of the High and Low Scoring Classes on 
the Percentage Frequencies in Each of the 
Ten Flanders Categories 



Flanders Category 


Mean 

High 


Percentaqe 

Low 


IJ- value 


1 


0.16 


0.00 


40 


2 


1.23 


1.56 


44 


3 


9.42 


3.62 


30 


4 


7.20 


4.27 


42 


5 


57.39 


52*80 


48 


6 


0.87 


1.32 


33 


7 


0.64 


0.48 


47 


8 


5.27 


3.79 


46 


9 


11.92 


12.15 


42 


10 


6.07 


19.56 


28 


n.b. values for U 
to be significant at the 


must be equal to or 
.05 level. 


less than 27 
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TABLE 7 

Comparison of Selected Flanders Aspects of 
Classroom Verbal Behavior for the High 
and Low Scoring Classes 



Flanders Aspect 


Mean 

High 


Ratio 

Low 


U- value 


Indirect-Direct Ratio 


0.26 


0.17 


37 


Teacher-Talk Ratio 


0.71 


0.64 


37 


Student-Talk Ratio 


0.17 


0.16 


46 


Content Ratio 


0.65 


0.57 


41 



n.b. values for the U must be equal to or less than 
27 to be significant at the .05 level. 



Hypothesis VII dealt, v/ith the differences among the 
classroom verbal interaction matrices for the high scoring 
classes of the three curricula with regard to the percentage 
frequencies in each of the ten categories and four selected 
aspects of verbal interaction. The mean percentage frequencies 
and the Kruskel-Wal lis H-values for each comparison are pre- 
sented in Table 8. 

The mean ratios for the selected aspects cf classroom 
verbal behavior among high scoring classes for the three phys- 
ics curricula and the respective Kruskel-Wallis H-values are 
shown in Table 9 . 
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Table 8 

Comparisons of Curricula for High Scoring Classes 
on the Percentage Frequencies in the 
Ten Flanders Categories 



Flanders Category 


Mean 

TP 


Percentage 

PSSC 


HPP 


H-value 


1 


0.00 


0.22 


0.00 


0.72 


2 


0.43 


0.99 


1.34 


0.61 


3 


17.61 


5. 75 


6. 00 


1.61 


4 


5.99 


11.69 


6. 13 


0.00 


5 


44.97 


55.13 


73.60 


2.75 


6 


0.92 


1.08 


2.55 


1.37 


7 


0.62 


0.84 


0.78 


0.18 


8 


2.10 


10.55 


3.47 


0.86 


9 


13.62 


8.84 


2.44 


4.46 


10 


9.39 


4.70 


4.78 


2.75 



n.b . values for H must equal or surpass 4.71 to be 
significant at the .05 level. 
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Table 9 

Comparisons of Selected Aspects of Classroom Verbal 
Interaction Among Three Physics Curricula 
for High Scoring Classes 



Verbal Interact! on 
Aspect 


TP 


Mean Ratio 
PSSC 


HP 9 


H— value 


Indirect -Direct 
Ratio 


0.33 


0.42 


0.14 


1.20 


Teacher -talk ratio 


0.71 


0.75 


0.89 


3.93 


Student - ta lk rati o 


0.20 


0.18 


0.06 


1.46 


Content ratio 


0.52 


0.65 


0.79 


2.79 



n.b r values for H must equal or surpass 4.71 to be 
significant at the c ,05 level. 

The application of the Kruskel-Wallis H-test to both 



the Flanders ten categories and the four selected aspects did 
not yieJ-d evidence of differences among the high scoring classes 
for the three curricula with respect to these variabJ.es. There- 
fore, the null statement of Hypothesis VII was accepted. These 
findings are in parallel to those of Hypothesis IV and VI, 
neither of which were rejected. 

S ummary 

The present section presents the outcomes component of 
the evaluation model. The outcomes may be classified as stu- 
dent achievement (analyvsis of test data), classroom climate 
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(analysis of classroom verbal behavior), and stxidenr achievement 
versus classroom climate (analysis of classroom verbal behavior 

for high and low scoring classes). 

PSSC students exhibited superior performance on compo- 
site achievement measures when compared with TP and KPP students. 
This superior achievement was found not only on entry to the 
curriculum but also on completion of that curriculum. However, 
the relative changes in student composite achievement for the 
three curricula were not found to differ. 

When comparing student achievement on each of the three 
measures of achievement, students exhibited equivalent ability 
as to critical thinking and understanding of science processes. 
However, upon entry to the curriculum, student achievement as 
to physics content was found to be significantly lower than the 
other two components of science knowledge mentioned pr eviotisly , 
and significantly greater than the other two components at the 
completion of the academic year. In terms of increased ability, 
change in physics content achievement was greater than change 
in understanding science processes, which, in turn, was greater 

than change in critical thinking. 

Student achievement on individual tests did not differ 
among the three curricula, indicating that no interactive effect 

occurred. 

When comparisons were made among the three curricula for 
the classroom climate variables, it was found that the curricula 
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differed for the total verbal interaction pattern. However, 
subsequent analyses of the ten categories and four selected 
aspects failed to isolate the differences in a clear and inter- 
pretable fashion. This can be interpreted to mean that evidence 
for differing classroom verbal behavior exists among these cur- 
ricula, but the Flanders categories and selected aspect ratios, 
in the currently used form, are insufficient to isolate the 
specific sources. 

The classroom climate, i.e., total verbal interaction 
pattern, of the classes exhibiting high student achievement 
was found to differ from the classroom climate of the classes 
exhibiting low student achievement. Analyses of the ten cate- 
gories and four selected aspects of verbal behavior again failed 
to isolate specific variables which contributed to the differ- 
ence found. in the total verbal interaction patterns, most likely 
for the reasons cited previously. 





Judgments, Discussion, and 
Recommendations 



Science educators have expressed the need for evalua- 
tion of the modern science curricula which have been developed 
in the past ten years. In response to this need a five compo- 
nent evaluation model was developed to aid in systematizing 
the evaluation process and to insure the consideration of key 
variables in such evaluation processes. 

The evaluation model was applied to a specific area of 
science education, physics, and its three major curricula — 
traditional physics (TP), Physical Science Study Curriculum 
(PSSC), and Harvard Project Physics (HPP) — as currently used 
in American high schools. The sample employed in the applica- 
tion of the model included 24 secondary schools in 7 states 
with 38 classes containing 954 physics students. Due to the 
random procedures used in sample selection, the sample may be 
considered as representative of high school physics students 
and curricula in the southwestern, midwestern, and western 
areas of the United States. 

The behavioral goals , the; first component of the model, 
consisted of two basic objectives of physics, mastery of phys- 
ics content, and acquisition of the process of science. The 
formative experiences , the second component of the evaluation 
model, consisted of assessing length of time in the educational 
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environment, academic aptitude, and entry level of attainment 
in both physics content and science processes of the students 
in the physics curricula. Sex of the student was also consid- 
ered as a potential element of cultural role differentiation 
in performance. The third component, transactions . consisted 
of the teaching triad. The fourth component, outcomes , con- 
sisted of the metrics of classroom climate — student cognitive 
behavior and the classroom verbal behavior . This classroom 
verbal behavior was quantified from audio tape recordings of 
both students and teachers involved in the three curricula, 
the recordings being made at several different times during 
the academic year. The judgments component of the model, the 
fifth and last, consisted of the subsequent analyses of quan- 
tifications leading to decision making as to relationships 
exhibited among teachers, students, and physics curricula. 

Although background characteristics of age, sex, aca- 
demic aptitude, and prior education may generally be considered 
as pertinent factors influencing student achievement (Thur- 
stone, 1947; Ausubel & Robinson. 1969), the results of formative 
experiences for the three groups of students (TP, PSSC, and 
HPP) were found to function homogeneously with respect to phys- 
ics achievement. Results of this study indicate that high 
school physics students are of above average academic ability 
and that neither grade level nor sex of a student is a deter- 
mining factor as to the level of achievement within any phys— 
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The students within each of the three curricula dis- 
played significant increase in physics achievement, not only in 
terms of the composite measures of physics achievement but also 
in respect to each of the three tested elements of physics 
achievement — physics content, science processes, and critical 
thinking. This increase in physics achievement was found typical 
of all curricula and therefore no ordering of curricula upon a 
continuum of "effectiveness" was possible. There was no evi- 
dence of a specific curriculum interacting in a differential 
manner with a particular component of physics achievement. On 
the bases of the student achievement measures, the three curri- 
cula must be judged as effective, as previously defined, and 
equivalent in implementation of learning of physics. 

Student achievement was found to differ as to particular 
aspects of physics achievement in that the increase in physics 
content mastery was greater than the increase in understanding 
science processes. Although the students' critical thinking 
ability was found to have increased significantly, this change 
was significantly less than - the change exhibited in the other 
two aspects of physics achievement. When viewed through the 
evaluation model, these findings led to the judgment that all 
three physics curricula were more effective in producing learn- 
ing of physics content than in developing an understanding of 
science processes, and least effective in developing critical 
thinking. This ordering of the three components as to 
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effectiveness must be viewed within the framework that the cur- 
ricula were found effective in each component and the ordering 
is relative to magnitude of change in final functioning level 
of students. 

The three curricula were found to differ as to classroom 
verbal interaction patterns; however, due to the nature of the 
Flanders' system for quantification, analyses permissible for 
isolating causal variables failed to provide specific evidence 
as to the sources of differences within patterns. The Flanders' 
system for quantification provides data of nominal scaling and 
therefore limits statistical analyses to nonparametric tests 
which may be considered less robust than parametpic tests. 

Within the evaluation model context, this finding led to the 
judgment that the three teacher-student-curriculum triads were 
different but clarification as to the exact nature of the differ- 
ences was not possible. 

Although statistical analyses of the classroom verbal 
interaction data did not reveal or isolate the specific differ- 
ences among the total verbal interaction patterns for the three 
curricula, there are certain trends that appear in the data that 
may explain differences among the classroom verbal interaction 

patterns for the three triads. 

The TP triad represents a classroom climate in which 
lecture is the principal mode of verbal behavior but to a lesser 
extent than HPP and to a greater extent than PSSC. Of the three 
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curricula, the TP students initiated more talk in class and the 
teachers expanded on the student ideas more than did the teach- 
ers within the other curricula. TP teachers tend to ask very 
few convergent questions when compared to PSSC teachers. 

Although the teacher-talk ratio (.73) is relatively high when 
compared to the student talk ratio (.19), there is considerable 
freedom for the student to initiate questions and a tendency 
for the teacher to expand on these ideas. Although the TP 
teacher is quite direct and concentrates on content dissemina- 
tion, there is a freedom for students to interact with the 
teacher and for their ideas to be utilized by the teacher. 

In the PSSC triad, there exists a tendency for the 
classroom to be less lecture controlled than either TP or HPP; 
however, there are many convergent questions asked by the teach- 
er. The TP triad and PSSC triad share common patterns of verbal 
behavior in teachers' accepting the building onto student ideas. 
Students in PSSC, as in TP, appear to feel free to initiate 
questions and the teacher spends time in developing the ideas 
suggested. The teacher-talk ratio (.56) and student-talk ratio 
(.24) are the smallest and largest respectively of the three 
triads. 

The most surprising results of trends in classroom ver- 
bal interaction patterns were exhibited in the HPP triad. HPP 
teachers demonstrated the highest frequency of lecture to the 
classroom for the three groups. Nearly 70% of the classroom 
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verbal activities were devoted to lecture as compared to 56% 
for TP and 39% for PSSC. There was very little acceptance of 
student ideas and relatively few student initiated questions. 

HPP teachers demonstrated a reluctance to solicit student state- 
ments either by direct questioning or by providing a climate for 
the students to initiate ideas of their own. The teacher-talk 
ratio (.78) and student-talk ratio ( ,14) further exhibited the 
large frequency of teacher directed verbal activities when com- 
pared to verbal activities of the HPP students. This may indi- 
cate that verbal interaction in HPP classes was not the type 
expected in a curriculum that has less structure for the stu- 
dent in its design. This may be a limiting factor for the HPP 
student . 



When summarizing the verbal interaction patterns for 
the three triads there are some common characteristics of the 
verbal classroom climate that appear. In each triad, the phys- 
ics teachers were quite conservative with praise or encourage- 
ment for the students although the teachers did not criticize 
or give lengthy directions. The primary concern of the teachers 
as a group was the dissemination of content information. 

The key differences in trends appear to focus on the 
type of questions asked, how frequently the students ask ques- 
tions, and how extensively the teacher utilizes and expands on 
the students' ideas. It appears that both TP and PSSC teachers 
create an atmosphere in which students feel free to ask or 
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initiate questions whereas this freedom seemed restricted in 
the HPP classrooms. This was not the type of atmosphere 
expected in the HPP curriculum and may be due, in part, to the 
teacher not being as secure in the course as in a course they 
had taught for a longer period of time. It could be due to 
teachers' practices , carried over, from experience in physics 
courses taught prior to teaching HPP. Both PSSC and TP teach- 
ers spend more of the class period developing or using ideas 
of the students than do HPP teachers. Although the PSSC teach- 
ers asked more questions than TP or HPP teachers, these ques- 
tions were convergent. 

The transaction component of the evaluation model may 
therefore be viewed as consisting of three distinct binary rela- 
tionships of classroom verbal behavior intersecting with a phys- 
ics curricula. However, each distinct relationship has resulted 
in similar student behavior on achievement measures. 

The classroom verbal interaction patterns of the class- 
room exhibiting high student achievement were found to differ 
from the patterns of classrooms with low student achievement. 

Once again statistical analyses of the verbal interac- 
tion data did not reveal or isolate the specific differences 
between the classroom verbal interaction patterns for the high- 
est and lowest scoring classes. There are, however, some trends 
that appear for high versus low scoring classes within the 
sample. Teachers of both groups utilized more than one-half of 
O 
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the class period in lecture. Very little praise or encourage- 
ment was offered the students in either group; however, the stu- 
dents were not given lengthy directions or criticized for their 
actions in the classroom. Both groups appear to have the free- 
dom to initiate questions. Student-talk and teacher-talk ratios 
for both groups were similar. The key differences in trends 
appear in the relatively high frequency of teacher questions, 
usage and expansion of student ideas, and the relatively small 
amount of the class devoted to confusion or silence in the high 
scoring classes when compared to the low scoring classes. 

The conclusions of the present study indicate that the 
evaluation model was applicable when applied to three ohysics 
curricula,, This finding tends to support the contention that 
the major goals of physics instruction consist of student mas- 
tery of physics content and understanding science processes. 

Only one judgment may be considered in conflict with previous 
evaluations of physics curricula. Day (1964), Rutledge (1965), 
and Brakken (1965) reported that students enrolled in PSSC 
achieved at a significantly higher level when compared to stu- 
dents in traditional physics in terms of critical thinking 
ability as measured by the Watson-Glaser Critical Thinking 
Appraisal . The present study did support the general contention 
that critical thinking can be enhanced during the duration of 
an academic year but this increase could not be attributed solely 
to a particular curriculum. This may be evidence of physics 
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instruction in TP courses evolving and being influenced in this 
evaluation by the more modern curricula of HPP and PSSC. 

Hence, reducing differences that reportedly existed earlier. 

The transactions component of the model facilitated the 
investigation of the hypothesized relationship among teacher, 
student, and curriculum. The three teaching triads, differen- 
tiated by curriculum, were found to differ as to classroom cli- 
mate, i.e., classroom verbal interaction patterns. The trends 
within the classroom verbal interaction patterns for the three 
triads seem to focus on the type of questions asked by the 
teacher, as determined indirectly from student answers, how 
frequently the students ask questions, and how extensively the 
teacher expands on the student’s ideas. It appears that both 
TP and PSSC teachers create a learning environment in which 
students feel free to ask or initiate questions whereas this 
freedom seems restricted in the HPP classrooms. Doth TP and 
PSSC teachers spent more of the class period developing or 
using ideas of students than HPP teachers. Although the PSSC 
teachers asked more questions than TP or HPP teachers, these 
questions were convergent. 

These trends suggest the possibility that TP and PSSC 
teachers were more familiar with their curricular materials 
than HPP teachers since it was the first year HPP had been uti- 
lized in the high schools. Since the previous comparative 
studies have not been conducted among the three curricula as to 
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this relationship, there is need for additional investigation 
to clarify and further describe the relationships of curricula 
to classroom verbal interaction patterns. There is also criti- 
cal need for either more refined measures of classroom verbal 
interaction or for statistical technigues which are more robust 
in their ability to deal with nominally scaled data. 

A similar condition exists with respect to the indicated 
difference in classroom verbal behavior between high and low 
achieving classes. The major differences in trends of the ver- 
^®1 interaction patterns appear in the relatively high freguency 
of teacher questions, usage and expansion of student ideas, and 
the relatively small amount of class devoted to silence or con- 
fusion in the high scoring classes as compared to the low scor- 
ing classes. Of the reviewed studies, only one has been 
conducted in this area of physics education* Pankratz (1966), 
although employing different criteria of effectiveness, reported 
results similar to those reported here. 

The findings of this study suggest the necessity for 
further research in the area of physics education. The trans- 
actions component of the model has identified certain trends 
that appear in the classroom vex'bal behavior patterns within the 
three triads, and also trends that appear in the hxgh and low 
scoring classes. These trends suggest that possibly other fac- 
tors, not considered in this study, might be worthy of consid- 
eration in future studies. Future studies might include the 
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students’ attitude toward teacher and course and the teachers' 
attitude toward the course and how these attitudes effect stu- 
dent achievement. 

It is further recommended that within each curriculum, 
research be conducted in structured versus unstructured class- 
rooms. There was some evidence in this study which indicated 
that students in unstructured classrooms achieved to a lesser 
extent than those in a more structured environment. It may be 
that student outcomes measured in this study correlate higher 
with a structured classroom situation than with unstructured 
and that outcomes of unstructured classrooms are different, 
to some extent, than those of structured classrooms. 

One of the most impressive findings of this study was 
the degree to which the physics teachers — in totem, exhibited 
serious-minded, concentrated, and dedicated efforts to enhance 
the learning of each and every student. In observing the class- 
rooms, a panorama of teaching techniques was noted. This pan- 
orama included student centered activities where the teacher 
was a resource person in the purest sense, multi— media presen- 
tations, small group discussions and investigations, and inde- 
pendent study by the students. Perhaps this high ability level 
of the teachers, irrespective of curriculum, is the primary 
factor contributing to the impressive effectiveness of each 

curriculum in enhancing student achievement. 

4 * 
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The HPP teachers, all of whom participated in formal 
instruction to familiarize them with i. he HPP curriculum prior 
to implementation, were successful, in utilizing some of the vari- 
ous teaching methods provided by the curriculum. The teachers 
utilized activities involving student reports, individual lab- 
oratory investigations, and lecture-discussions in implementing 
the curriculum with ninth grade students as well as twelfth 

students. Although the design of the course provides for 
maximum flexibility with regard to teaching strategies, the 
teachers did not demonstrate flexibility in classroom verbal 
interacti on . 

The PSSC teachers, utilizing relatively few basic con- 
cepts of physics, a multitude of audio-visual materials and 
inquiry methods, were able to interact with their eleventh and 
twelfth grade students in such a manner as to apparently fulfill 
the objectives of the curriculum. 

The TP teachers were surprisingly verbal inquiry 
i n methodology. Apparently, they have taken the .classi- 
cal physics units of the past and brought new life to the mate- 
The broad spectrum of modern teaching methodology was 
interfaced with tradition in their classrooms resulting in a 
physics curriculum which can not be considered "traditional." 

The high degree of effectiveness of such an interface is exhibited 
by the fact that ten of the eleven TP classes achieved outstand- 
ingly on each aspect of physics knowledge. 
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The findings and observations tend to suggest that the 
crucial factor determining effectiveness of a physics curricu- 
lum is the expertise of the teacher. This expertise must not 
only be in physics content, but also in implementation of the 
scientific methods of psychology and learning theory. There- 
fore, based upon this study, the recommendation must be made 
that preparatory and in-service teacher training programs 
emphasize flexibility in providing for individual differences 
and establishment of a conducive socio-emotional climate for 
the classroom. 

The limitation in applying the evaluation model appears 
to be the lack of precision in quantifying and analyzing data 
from the transactions component. The recommendation must be 
made that due to the crucial need for information in this area 
of evaluative models, intensive refinement of measuring instru- 
ments is of utmost importance. It has been demonstrated that 
the proposed evaluative model is applicable and produces judg- 
ments that can lead to effective curriculum comparisons. The 
applicability of the present model is limited by the quality 
of data available from the classroom behavior instruments and 
the techniques for their analysis. The development of stronger 
uses of the proposed model — or others which might parallel its 
utility — appear to depend upon strengthening the definition and 
assessment of the elements that make up the complex interplay 
of teachers, students, curricular materials, and instructional 
techniques in the classrooms. 93 
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University of Houston 

COLLEGE OF EDUCATION 

CmiTN BOLTLEVAXD 

HOUSTON, TEXAS 77C04 



cxilum and instruction July 22, 1968 

BKONDAM EDUCATION 



Dear Colleague, 

The strength of the nation's science programs has grown rapidly in the 
past few years. This improvement is partially attributed to teachers 
who have willingly taken an active part in the various supportive research 
projects. You are invited to participate in a study of national interest 
in physics education at the University of Houston, Houston, Texas. 

The study itself will involve Harvard Project Physics, PSSC, and tradi- 
tional physics. We are conducting research which centers around 
processes and outcomes in the various physics courses. The evaluation 
techniques will consist of pretesting in September, 1968, and post- 
testing in early May, 1969. Testing time will be approximately two and 
one-half hours each time. During the year we will tape (audio) approxi- 
mately three classes. This taping would cause minimal disturbance in 
your normal classroom procedures. 

We feel the findings of this study will serve the interests of physics 
education on the secondary level and should prove helpful to you in 
evaluating your physics program. All scores and interpretations will 
be available to you. We will furnish you with individual scares of 
each student on both the pre- and posttests. These scores will be on 
standardized instruments so you could compare with established norms. 
Furthermore, we will furnish you with the mean scores from other 
schools participating in the study. However, no mention of schools 
will be made. If you so desire, the test scores could be used for 
evaluating individual student progress. 

The audio tapes of your class will simply be used to determine what 
classroom processes are being used in the various types of physics 
courses. The days of your taping sessions will be planned at your 
convenience. The tapes and their analyses will be discussed with 
you . 

There will be no cost to any school. You will be provided with ail 
test results, yours as well as other participating schools, and audio- 
tape analysis cost free. 

The results of our research are intended for the advancement of physics 
education, and this is not an attempt to evaluate an individual s chool , 
teacher , or s tudent . All information will be treated as confidential 
data. The results of our study will be made available to you in 
summary form again at no cost to you or your school. 

Without the help of interested and concerned teachers in the field of 
physics, our study cannot be successfully accomplished. This makes 
very important part of this; study. 
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If you feel that you would consider participating in such a study, would 
you fill out the following questionnaire. 

YES NO 

1. f ] | 1 Would you be willing to participate in this research if 

] 1 1 —I your administration gives its approval? 



2 . Name 
City 



, State 



Home Address 



(Street) 

Phone 



3. Which of the following physics courses do you plan to teach during the 
1968-1969 school year? 



1 | PSSC 


[ | Traditional Physics 


j ) Project Physics 


| | Other Explain 



4* Give the name of the school administrator we should contact in seeking 
permission to do research in your physics class. 



Name 



School 



Address ___ ___ 

(Street) 



(City) 



(State) 



Phone _ 

On the basis of your response, I will contact your administration in 
regard to possible participation in the research. 

Thank you for your cooperation and help. We look forward to working with 
you this fall. 



Respectfully, 

T. C. Smith ' 

Principal Investigator 




Silas W. Schirner, Project Director 
Science Education 
University of Houston 
Houston, Texas 
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Participating Schools 



Name of School 



Location 



Traditional Physics 



1. Robert E. Lee High School 

2. J. Frank Dobie High School 

3. Brenham High School 

4. Needville High School 

5. Angleton High School 

6. Booker T. Washington 

High School 

7. Ross Sterling High School 

8. St, Pius X High School 



Baytown , 
Pasadena 
Brenham , 
Needvill 
Angleton 

Houston , 
Baytown , 
Houston , 



Texas 
Texas 
Texas 
, Texas 
Texas 

Texas 

Texas 

Texas 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 



PSSC Physics 



Thomas Jefferson High School 

Sam Houston High School 

Kincaid School 

St. Thomas High School 

Mercy Academy 

D ueblo High School 

West Jefferson High School 

Mount Carmel High School 

Strake Jesuit School 

San Diequito High School 



Port Arthur , Texas 
San Antonio, Texas 
Houston, Texas 
Houston, Texas 
New Orleans, Louisiana 
Tucson, Arizona 
New Orleans, Louisiana 
New Orleans, Louisiana 
Houston, Texas 
Cardiff, California 



Harvard Project Physics 



Chaminade School 
Emerson High School 
San Diequito High School 
Unified High School 
Mercy Academy 
Griffin High School 
Aviation High School 
Alhambra High School 



St. Louis, Missouri 
Gary, Indiana 
Cardiff, California 
Belle Plaine, Kansas 
New Orleans, Louisiana 
Springfield, Illinois 
Redondo Beach, California 
Phoenix, Arizona 
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Matr ix for 
Analysis 



Teacher- 

talk. 

Indirect 

Influence 



1. ACCEPTS FEELING: accepts and clarifies the feel- 

ing tone of the students in a nonthreatening manner. 
Feelings may be positive or negative. Predicting or 
recalling feelings are included. 

2. PRAISES OR ENCOURAGES: praises or encourages 

student action or behavior. Jokes that release ten- 
sion, not at the expense of another individual, nod- 
ding head or saying "urn hm?" or "go on" are included. 

3. ACCEPTS OR USES IDEAS OF STUDENT: clarifying, 

building, or developing ideas suggested by a student. 
As a teacher brings more of his own ideas into play, 
shift to category five. 

4. ASKS QUESTIONS: asking a question about content 

or procedure with the intent that a student answer. 



Teacher- 

talk 

Direct 

Influence 



5. LECTURING: giving facts or opinions about con- 

tent or procedure; expressing his own ideas, asking 
theoretical questions. 

6. GIVING DIRECTIONS: directions, commands, or 

orders to which a student is expected to comply. 

7. CRITICIZING OR JUSTIFYING AUTHORITY: statements 

intended to change student behavior from nonaccept able 
to acceptable pattern; bawling someone out; stating 
why the teacher is doing what he is doing; extreme 
self -re fere nee. 



Student- 

talk 



8. STUDENT TALK — RESPONSE: a student makes a pre- 

dictable response to teacher. Teacher initiates the 
contact or solicit student statement and sets limits 
to what the student says. 

9. STUDENT TALK — INITIATION: talk by students 

which they initiate. Unpredictable statements in 
response to teacher. Shift from 8 to 9 as student 
introduces own ideas. 



10. SILENCE OR CONFUSION: pauses, shorty periods of 

silence and periods of confusion in whicji communica- 
tion cannot be understood by the observer. 



Figure 6 
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Figure 7 

Sample Interaction Matrix 
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APPENDIX D: Composite Verbal Interaction Data 



Matrices of the Curricula 
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TABLE 10 

Composite Matrix of Eight Traditional Physics Classes 
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Total observations, N = 5,327 

’Expressed in percent of total observations 
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Composite Matrix of Ten PSSC Physics Classes 
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TABLE 12 

Composite Matrix of Eight HPP Classes 
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APPENDIX E: Composite Verbal Interaction Data 



Matrices of High and Low Achieving 
Classes 
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TABLE 13 

Composite Matrix of the Ten Highest Scoring Classes 
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Total observations, N = 4,161 

'Expressed in percent of total observations 
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Table 15 

Correlation Coefficients of Formative Experiences, 
Achievement Measures, and Curricula 





Formative Experiences 




Academic 

Aptitude 


Sex 


Grade Level 


TP 


-.48 


.15 


-.02 


PSSC 


-.33 


-.10 


.03 


HPP 


-.42 


-.19 


-.02 


DAPT Pretest 


-.16 


-.19 


.17 


DAPT Posttest 


-.03 


,.19 


-.19 


WISP Pretest 


-.09 


.13 


-.19 


WISP Posttest 


-,.11 


.07 


-.01 


WGCTA Pretest 


-.09 


.05 


.03 


WGCTA Posttest 


-.09 


.06 


.03 



Note: Pearson's product moment correlation 

coefficients. 
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Name: T. C. Smith, Jr. 

Born: February 18, 1937, Normangee , Texas 

Education: B.S., 1959, Sam Houston St-ate College, 

Huntsville, Texas 

M.Ed. , .1961, Sam Houston State College, 

Huntsville, Texas 

Ed.D. , 1971, University of Houston, Houston, Texas 

Additional, graduate work: f 

University of Arizona 
Tucson, Arizona 
1366-1967 

Trinity University 
San Antonio, Texas 
Summer, 1967 

Texas A & M University 
College Station, Texas 
1964-1966 



Professional 

Experiences: Sam Houston State College 

Huntsville, Texas 
Instructor, physical science, 

physics, and mathematics 

Blinn Junior College 
Brenham, Texas 

Chairman, Physics Department 

University of Houston 
Houston, Texas 

Teaching Fellow, Curriculum & Instruction 
Instructor, Science Education 
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